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(54) A scheduling method and apparatus for supporting ATM connections having a guaranteed 
minimum bandwidth 



(57) The invention discloses a method and an ap- 
paratus for use in the packet networks and particularly 
Asynchronous Transfer Mode (ATM) networks to sup- 
port traffic of connections requiring a minimum band- 
width at connection establishment. The method and the 
apparatus further support any mixed traffic including 
connections requiring a minimum bandwidth, a fixed re- 
served bandwidth or no bandwidth at connection estab- 
lishment. 

The invention consists in using a first scheduler trig- 
gered by absolute time for scheduling the Minimum 



Service connections up to a rate corresponding to their 
reserved minimum bandwidth reserved, a second 
scheduler and a queue of Minimum Service connection 
identiers for communication between the two schedul- 
ing schemes. 

With the dual scheduling mechanism of the inven- 
tion the minimum bandwidth for connections reserving 
a minimum bandwidth at connection establishment is 
guaranteed in each point of the connection path and at 
any time, the level of fairness of the remaining band- 
width sharing depending on the quality of the second 
scheduler. 
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Description 

FIELD OF THE INVENTION 

This invention relates in general to a networking 
communication system and more particularly to ATM 
network nodes supporting a service guaranteeing a min- 
imum bandwidth to the user connection. 

BACKGROUND OF THE INVENTION 

Asynchronous Transfer Mode (ATM) is to become 
the base technology for the next generation of high 
speed networks. High speed networks support a great 
diversity of applications with different traffic and Quality 
Of Service ( QoS ) requirements. Such diversity require 
different control flow strategies. For example, certain 
applications like multimedia and time critical data appli- 
cations require guaranteed levels of delay and through- 
put but can tolerate losses, while others like LAN traffic 
can tolerate variations in delay and throughput but are 
very loss sensitive. 

In the ATM Reserved Bandwidth ( RB ) service, a 
user needs to establish a traffic contract with the net- 
work at call set-up before transmitting data. The contract 
includes specification of a desired QoS class and a set 
of traffic descriptors. The network, through resource al- 
location, provides the desired QoS for the ATM connec- 
tion or refuses the call. The allocated bandwidth be- 
tween a source and a destination may be less than the 
peak rate in order to benefit from statistical multiplexing 
gains, but it requires complex software and may cause 
traffic congestion and data losses. 

In a LAN environment, sources are bursty and un- 
predictable. Traffic has an extremely high variability on 
time scales ranging over several orders of magnitude. 
For such unpredictable sources, the peak rate could be 
allocated in order to avoid heavy losses inside the net- 
work. However the network would be inefficiently used, 
since bandwidth would be reserved even during idle pe- 
riods. 

One way to increase link utilization for the network is 
through the addition of a Non Reserved Bandwidth ( 
NRB ) service class. In this service class, no bandwidth 
at all is reserved and the sources can transmit on a best 
effort basis, grabbing as much bandwidth among the re- 
maining bandwidth as they can, without affecting the RB 
traffic. Thus, no resources being allocated in advance, 
the NRB service requires a control flow scheme in order 
to control the sources. The quality of the flow control 
mechanism qualifies the efficiency of the NRB service 
support in terms of cell loss ratio. The hop-by-hop con- 
gestion flow control mechanism disclosed in the Euro- 
pean patent application EP94480125 implemented in 
the network nodes on the connections path is an im- 
proved flow control mechanism. With the selective (per 
connection) or global backpressure commands sent 
from an adjacent node, the entering traffic is selectively 



or globally resumed or throttled in^each hop of the con- 
nection path. 

However. NRB connections have no guarantee at 
all to be served by the ATM network, as discussed in the 

5 ATM Forum Technical committee in the traffic manage- 
ment working group, a need for a new service category 
is identified with the Available Bit Rate (ABR) service 
situated between the reserved and non reserved band- 
width services. For an ABR connection, the end-system 

io shall specify to the network both a maximum required 
bandwidth (Peak Cell Rate. PCR) and a minimum re- 
quired bandwidth (Minimum Cell Rate, MCR). The ABR 
service as defined at the ATM Forum includes also a 
flow control protocol between the source and the desti- 

15 nation. The end-system is supposed to adapt its traffic 
in accordance with the feedback received from the flow 
control mechanism. The characteristics expected from 
ABR service is a guaranteed minimum bandwidth, a fair 
share of the available bandwidth and, with the flow con- 

20 trol protocol, a low cell loss ratio. As this service cannot 
control cell transfer delay, it is not intended to support 
real time applications. It applies to the same applications 
than NRB service but when the end-system requires a 
guaranteed QoS: critical data transfer (such as Defense 

25 information), super computer applications and any data 
telecommunication (as for NRB service : email, telex, 
fax, banking transactions, LAN interconnection etc..) 
requiring better delay behavior (such as distributed file 
transfer, remote procedure call, computer process 

30 swap/paging). 

While the cell loss ratio of the ABR service will de- 
pend on the quality of the flow control, the characteris- 
tics expected for the ABR service as for the guaranteed 
minimum bandwidth per connection and the fair sharing 

35 of the available bandwidth, depend on the quality of the 
scheduling scheme. In the ATM network nodes of the 
industry, with this emerging ABR service, there is a need 
for providing a scheduling scheme able to support con- 
nections having a minimum bandwidth guaranteed and 

40 a fair share of the available bandwidth. This so called 
hereunder 'Minimum Service* support, guarantees to 
each connection for which a minimum bandwidth has 
been required and accepted at connection set-up 
(MCR), to have this minimum bandwidth. Depending on 

^5 the quality of the scheduling scheme implemented in the 
network nodes of the connection paths, the minimum 
bandwidth can be guaranteed either globally on the path 
or at any time and in each node of the network nodes. 
The both way of guaranteeing a minimum bandwidth are 

50 compliant with the MCR parameter. The second char- 
acteristic of Minimum Service support is a fair sharing 
of the 'remaining' bandwidth: this later comprises the 
bandwidth not reserved for the minimum service traffic 
and the part of the bandwidth reserved but not used by 

55 the minimum service traffic. By a matter of fact, if the 
scheduling scheme for support of Minimum Service can 
be combined with a network flow control mechanism 
such as the ABR flow control, the resulting support 
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would improve the cell loss ratio. The more the network 
flow control is efficient, the more the cell loss ratio is low. 

It is a first object of the invention to provide a sched- 
uling scheme for support of Minimum Service connec- 
tions such as ABR connections, guaranteing the mini- 
mum usable bandwidth to each connection and a fair 
share of the remaining bandwidth between these con- 
nections. 

It is a second object of the invention that the mini- 
mum bandwidth of each Minimum Service connection, 
if requested, is actually provided independently of the 
respective incoming rates of the other connections sup- 
ported in the node. More particularly, the minimum 
bandwidth allocated to each Minimum Service connec- 
tion is guaranteed even if the aggregate incoming traffic 
exceeds the output capacity. 

It is a third object of the invention to support any 
mixed traffic comprising RB (CBR, VBR for the ATM Fo- 
rum) or NRB (UBR for the ATM Forum) or Minimum 
Service connections such as the ABR connections de- 
fined at the ATM Forum, while maintaining the same 
characteristics or QoS expected for each type of service 
as if they where served alone; particularly, maintaining 
a low CLR for ABR service. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 illustrates a solution for scheduling mixed 
RB and NRB traffic in a network node. 

Figure 2 illustrates the scheduling of the Minimum 
Service traffic in a network node according 
to the method of the invention. 

Figure 3 illustrates the scheduling of mixed RB, 
NRB and Minimum Service traffic in a net- 
work node according to the method of the 
invention. 

Figure 4 shows the flow chart describing the basic 
operations for scheduling the RB and the 
minimum bandwidth traffic of the Minimum 
Service traffic according to the present in- 
vention. 

Figure 5 shows the flow chart describing the basic 
operations for serving the minimum band- 
width traffic of the Minimum Service con- 
nections, the NRB traffic and the remaining 
bandwidth traffic of the Minimum Service 
connections according to the present in- 
vention. 

Figure 6 illustrates one implementation of the meth- 
od of the invention in a network node. 

Figure 7 illustrates the support of the minimum serv- 
ice according to the present invention used 



for the ABR service with optional network 
flow control. 

Figure 8 shows the flow chart describing the basic 
5 operations for serving minimum service 

and NRB service connections with the use 
of two scheduling schemes as for the com- 
plementary scheduling. 

W SUMMARY OF THE INVENTION 

The invention discloses a method for receiving and 
transmitting in a packet network node the packets of 
connections having a minimum of bandwidth required 
'5 at connection establishment: said method comprising 
the steps of: 

receiving a packet in a dedicated connection queue: 
scheduling, under the control of absolute time, the 
connection queues according to the rate corre- 
sponding to their reserved bandwidths: 
storing queue identifiers of the scheduled connec- 
tion queues: 

reading the stored connection queue identifiers, 
and if any identifier is found, transmitting the first 
packet, if any packet is found, of the connection 
queue corresponding to the identifier read: 
if no identifier is stored, scheduling the connection 
queues and transmitting the first packet, f any pack- 
et is found, of the scheduled queues. 

More particularly, the method of the invention can 
be used for ATM networks where the packets are ATM 
cells. 

The invention discloses also an apparatus imple- 
menting the steps of the method which can be used in 
the adapters of the network node. 

With the solution of the present invention, a dual 
scheduling is proposed: the first scheduler guarantees 
up to the minimum bandwidth when required by a Min- 
imum Service connection: the complementary schedul- 
ing shares the remaining bandwidth among the connec- 
tions with no impact on the scheduling of the minimum 
bandwidth. Furthermore, the first scheduling can handle 
the RB traffic with the QoS required by the ATM Forum: 
in parallel, the complementary scheduling can handle 
NRB traffic as well, with fairness sharing of the band- 
width among NRB and Minimum Service connections 
when the scheduler is a Round Robin scheduler: com- 
bined with the ABR feedback mechanism, the schedul- 
ing scheme of the present invention supports the ABR 
service of the ATM Forum. The complementary sched- 
uler can be submitted to the commands of a network 
control flow such as the hop-by-hop mechanism of the 
prior art bringing a loss free service for NRB and Mini- 
mum Service support. 

With the scheduling of the present invention the 
minimum bandwidth is respected in each node point of 
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the connection path and at any time. In respect with the 
minimum bandwidth required at connection establish- 
ment by a minimum service connection, the minimum 
bandwidth is provided in a 'deterministic' and not a 'sta- 
tistical* manner in the network. 

Detailed description of the preferred embodiment 

Figure 1 illustrates the support of two ATM services, 
the RB service and the NRB service. These services are 
supported by independent scheduling schemes, the 
scheduling of RB service has a priority over the NRB 
service; the scheduling of the NRB service is activated 
when the RB service is not active and provide a sharing 
of the remaining bandwidth between the various NRB 
connections. Coming back to the implementation of Fig- 
ure 1 , the ATM label of the incoming cell is first looked- 
up in order to determine which service the cell belongs 
to (1 00). The set of RB connections queues such as 1 40 
and of NRB connections queues such as 155 are man- 
aged by independent scheduling schemes. The cells of 
NRB connections are queued in an intermediate queue 
(101) allowing a variable process time of the NRB traffic, 
one example being to make NRB queues 155 readable 
by the second of the two independant scheduling 
schemes only if they are not empty. This later operation 
improves the efficiency of the second scheduling 
scheme but increases the enqueuing time when a cell 
is to be queued in an empty queue 155. In the case 
where media speed cannot be sustained due to the ad- 
ditional processing, the intermediate queue 101 is add- 
ed: this implementation is chosen for the preferred em- 
bodiment. The enqueueing process in queues 140 for 
RB traffic and in intermediate queue 101 for NRB traffic 
is performed at media speed. In the case where there 
is no intermediate queue 101 , the enqueuing in queue 
1 40 and in queue 1 55 is performed at media speed. The 
RB scheduling scheme has priority and can interrupt the 
NRB one at any necessary time. The scheduling 
scheme for RB service illustrated in Figure 1 works as 
follows: the optional policing function (110) checks the 
incoming cell flow against the traffic contract established 
at call set-up. Non compliant cells are discarded if nec- 
essary. An optional shaping function (111) reschedules 
the departure of the cells according to the traffic contract 
in order to reduce the Cell Delay Variation (CDV), if any, 
of the incoming cell flow accepted by the policer accord- 
ing to its CDV tolerance setting. While the policing func- 
tion is triggered by cell arrivals, the shaping function 
(which is based on a leaky bucket algorithm or a depar- 
ture calendar) is triggered by the absolute timing inter 
cells intervals (Tics) 1 90. When a connection is shaped, 
the corresponding connection queue (1 40) is scheduled 
by the shaper, in the case where it is not empty, the cell 
at the head of the queue is dequeued from the connec- 
tion queue 140 and enqueued in the RB service queue 
160 for transmission on an output line: when a connec- 
tion is not shaped, the cells of this connection are direct- 



ly queued in the RB service queue (160). Queue 160 
only serves as a pipeline unit between the shaper and 
the output line. The cell transmission function (120) 
empties the RB service queue 160 and sends the cell 
s on the output line. If the RB queue is empty, the cell 
transmission function transmits a cell of the NRB service 
if such a cell is ready in the NRB cell space 170. The 
scheduling scheme for mixed NRB and RB services 
support is also illustrated in Figure 1. The scheduler of 

io the NRB service (130) selects a non empty connection 
queue (the Round Robin scheduler being one example 
of scheduling) and moves the first eel! of the connection 
queue to the NRB cell space (170) for transmission. As 
with processing of NRB traffic, the intermediate queue 

75 101 allows a variable processing time for the Minimum 
Service while sustaining media speed rate in average. 
The processing of the NRB service may be instantane- 
ously halted by any operation from the priority opera- 
tions (147) serving the RB traffic (145); optionally, a flow 

20 control mechanism such as the one of the prior art, com- 
prises selective backpressure commands (some NRB 
connections) or a global backpressure command (all 
NRB connections) applied to the scheduler of the NRB 
traffic (195). The selective backpressure command se- 

25 lects or deselects one connection queue of the Round 
Robin scheduler and the global backpressure command 
stops or restarts the Round Robin scheduler (130). 

Using the optional shaping and policing functions of 
the prioritized scheduling of the RB traffic combined with 

30 an efficient call admission control being not part of the 
invention, the Quality of Service for the RB traffic is char- 
acterized by a very low cell loss ratio (under 10" 20 ) a 
max Cell Delay Transfer as well as a max Peek to Peek 
CDV when relevant which are guaranteed for said traf- 

35 fic. The characteristics of the NRB service depend on 
the type of scheduler (130). A Round Robin scheduling 
would guarantee a fair sharing, according to the well- 
known 'Max-min algorithm' criterion, of the remaining 
bandwidth between all the NRB connections. Fairness 

-to is no more respected if the NRB scheduler is a simple 
FIFO. On top of that, as already mentioned, the cell loss 
ratio depends on the quality of the flow control mecha- 
nism when used: the hop-by-hop flow control of the prior 
art guarantees a loss-free NRB service. 

-ts Using the two prioritized scheduling mechanisms 
supporting a mixed traffic generated by RB and NRB 
connections, the dual scheduling mechanism illustrated 
in Figure 2 allows support of the Minimum Service con- 
nections in a network node and each node along the 

50 connection paths. Once identified by the ATM label look- 
up mechanism (100). the cells of the Minimum Service 
connections are queued in the intermediate queue 
(101), when it is implemented, before being enqueued 
in a dedicated Minimum Service connection queue 

55 (1 50). According to the dual scheduling mechanism of 
the invention, the connection queues of the Minimum 
Service connections are first scheduled by a shaper unit 
(111) insuring that each connection will get at least its 
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minimum bandwidth; any type of shaper can be used 
such as a leaky bucket or a calendar. A complementary 
scheduling scheme shares the remaining available 
bandwidth between said connections. This remaining 
bandwidth is the bandwidth not served by the shaper. 
Cell desequencing of the Minimum Service traffic is 
avoided by transmitting the minimum bandwidth traffic 
and the remaining shared bandwidth traffic through the 
same way, namely the celi space 170. The cell space 
1 70 of the preferred embodiment is a flip-flop or a limited 
space smoothing the scheduled output traffic. Conten- 
tion problem for accessing the shared resources (Mini- 
mum Service connections queues such as 150 and cell 
space 1 70) is solved by adding a queue of queues ( 1 74) 
in which the shaper queues the queue identifiers of the 
Minimum Service connections that it has scheduled in- 
suring their minimum service traffic in the case their 
queues (150) are not empty. In the preferred embodi- 
ment, while the shaper is under the control of the abso- 
lute time (1 90) . the complementary scheduling scheme 
works each time it can access the resources shared with 
the shaper (storage units containing connection control 
blocks). The complementary scheduling may be instan- 
taneously halted (145) by any operation from prioritized 
operations of area 1 47 such as the shaper, the ATM cells 
look up (100), the cell transmission (120) and the en- 
queueing of the incoming traffic (101, 140). Each time 
the complementary scheduling is active and as soon as 
the cell space 170 is not full, a priority mechanism func- 
tion (178) dequeues from the queue of queues 174 the 
ready identifier, if the queue of queues is not empty (Min- 
imum traffic to be served): the ready cell is then de- 
queued from the Minimum Service connection queue 
150 corresponding to the identifier and the cell space 
170 is filled with the ready cell. If the queue of queues 
is empty, the Minimum Service connection queue se- 
lected by the complementary scheduling is the queue 
pointed by the Round Robin scheduler (130). The 
scheduler of the preferred embodiment of the present 
invention brings a fair sharing of the available bandwidth 
between the queues 150. However, any scheduler can 
be used instead of a Round Robin scheduler according 
to the object of the invention. 

Figure 3 illustrates a mixed environment comprising 
support for Minimum Service connections as well as RB 
and NRB ones according to the solution of the present 
invention. If the cell identified by the ATM label look-up 
function ( 1 00) is a cell of a Minimum Service connection, 
after buffering in the intermediate queue (101), it is en- 
queued in a connection queue (150) reachable by a 
scheduler (1 30) and a shaper (1 1 1 ). The Minimum Serv- 
ice queues are then scheduled with the same compo- 
nents and as described in Figure 2. If the cell identified 
by the ATM label look-up function, depending if the RB 
connection is shaped or not (the shaper is optional for 
RB connections), the RB cell is queued in a connection 
queue 1 40 or. directly in the RB service queue 1 60. The 
RB traffic is scheduled as described in Figure 1 . It is as- 



sumed that the total reserved bandwidth of the RB traffic 
and the total minimum bandwidth of the Minimum Serv- 
ice traffic is controlled by a connection admission control 
insuring that it remains lower than the out link capacity. 
s if the cell identified by the cell label look-up function 
(1 00) is a cell of a NRB connection, after buffering in the 
intermediate queue (101), it is queued in a connection 
queue (155) reachable by the scheduler (130) used for 
the complementary scheduling of the Minimum Service. 

to The queues of the NRB connections (155) are sched- 
uled by the scheduler (130) when active and when the 
queue of queues (174) for Minimum Service connec- 
tions is empty (no minimum traffic to be served). The 
scheduler (1 30) does not know the type of queues that 

15 it handles. Consequently, the queues for Minimum Serv- 
ice, 150 or for NRB, 155 are scheduled with the same 
priority by the scheduler (130). 

In another embodiment, the complementary sched- 
uling scheme of the minimum service connections and 

20 the scheduling of NRB connections are performed by 
two different scheduler themselves controlled by a fixed 
rule such as alternately processing. An obvious property 
of this embodiment is to control the available bandwidth 
sharing according to the type of service. In the example 

25 where the two schedulers run alternatively, each serv- 
ice, Minimum Service and NRB service, gets, when nec- 
essary, half of the available bandwidth. In this embodi- 
ment, when a service requests less bandwidth than it is 
actually available, the other service can benefit from this 

30 bandwidth. In the cited example, if NRB service does 
not need more than 1/4 of the available, bandwidth, the 
minimum service will benefit from 3/4 of the available 
bandwidth. 

The scheduler 130 of the complementary schedul- 
es ing scheme is optionally submitted to a flow control 
mechanism, the benefit being for the remaining band- 
width sharing of Minimum Service and for NRB service 
an improved cell loss ratio. As illustrated in Figure 3. the 
NRB scheduler 130. when a network traffic flow control 
-to is exercised, is submitted to the traffic flow control com- 
mands (195). With the traffic control flow cited as the 
prior art, a global backpressure halts the scheduler 
(130) which results in scheduling with the shaper only 
the connections of the Minimum Service: Minimum 
Service connections get only their minimum bandwidth. 
Similarly, when a selective 'stop* backpressure is re- 
ceived, the corresponding connection queue (150 for 
minimum service connection or 155 for NRB service 
connection) is no more selected by the NRB scheduler 
so 1 30: a Minimum Service connection selectively stopped 
gets only its minimum bandwidth. As a summary, when 
the hop-by-hop traffic control flow mechanism of the pri- 
or art is used with the scheduling scheme of the present 
invention, the Minimum Service is loss free. 
55 Figure 4 describes the operational flow of the shap- 
er operations in the context of the preferred embodiment 
of the invention in the case where the RB connections 
are shaped. It shows the scheduling of the RB connec- 
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tions and the minimum bandwidth of the Minimum Serv- 
ice connections. At each cell time (205) , when one 
queue is selected by the shaper (right branch of test 
208) and when the queue selected belongs to the RB 
service (left branch of test 200) the selected queue 140 
is tested: if empty, a new cell time is waited for: if queue 
140 is not empty, the corresponding cell in the queue 
140 is dequeued (202) and enqueued in queue 160 for 
transmission. The dedicated processing for the mini- 
mum scheduling of the Minimum Service starts when 
the queue selected belongs to the Minimum Service 
(right branch of test 200); if queue 150 is empty, a new 
cell time is waited for (right branch of test 21 2); Minimum 
Service is served if the queue 150 is not empty (left 
branch of test 212): . The Queue-in-Queue bit (QiQ) 
read in the Control Block of the connection is then tested 
(214) for error detection. If the QiQ bit is not set, the 
identifier of selected queue is then queued in the Queue 
( 1 74) of Queues (216) and the QIQ bit is set (218). If the 
QiQ bit is already set in the Control Block of the Minimum 
Service connection, this means that the corresponding 
queue is already queued in the queue of queues (174). 
In this case in the preferred embodiment of the invention 
the operation has to be aborted since an element cannot 
be queued twice in a queue. However, this error event 
which expresses that the Minimum Service is seriously 
delayed has a very low probability (in the same order 
that the cell loss ratio of the RB service, that is to say 
10' 20 ); one can replace the queue of queues (174) by 
an ordered list which would permit to still process a 
queue in the case it already belongs to the list: however, 
with such an implementation the same problem would 
have to be faced when the list is exhausted. 

Figure 5 describes the operational flow of the com- 
plementary scheduling operations in the context of the 
preferred embodiment of the invention. It shows the op- 
erational flow of the scheduling of NRB service and the 
Minimum Service . When the queue 174 is not empty ( 
left branch of test 220) ( the corresponding Minimum 
Service connection queue (1 50) is dequeued (222) from 
the queue of queues (174) and the state "Minimum Serv- 
ice' is set (224) . If the test 220 result is Yes, the queue 
of queue (1 74) is empty and there is no waiting Minimum 
Service connection to be served according to its mini- 
mum guaranteed bandwidth. This means that the 
scheduler 130 (Round-Robin for the preferred embodi- 
ment) will select (221 ) one connection queue among the 
Minimum Service connections queues (150) or the NRB 
connection queues (155) which have the same priority 
for the scheduler. If the queues 1 50 and 1 55 are empty 
the scheduler has no work to do ('No Work' branch) and 
the priority mechanism is reactivated (go to step 220). 
Else, in step 223 the cell space 1 70 is tested: if not full, 
the selected queue is dequeued, stored in the cell space 
(170) and the cell space is set full if appropriate. If the 
'Minimum Service state' is set (test 225) . the indicators 
of Minimum Service are reset (226). that is to say QiQ 
bit of the selected Minimum Service queue and 'Mini- 



mum Service state'. 

Figure 8 : similarly to Figure 5 describes the NRB 
cell process serving the Minimum Service and the NRB 
service. On the contrary of Figure 5 t there are two 
5 scheduling schemes for insuring sharing of available 
bandwidth between the Minimum Service and the NRB 
connections according to the preferred embodiment 
suggested in the description of Figure 3. The algorithm 
supporting this embodiment differs from the one de- 

w scribed in Figure 5 at step 221 which is the activation of 
NRB scheduler 1 30. The step 821 replaces the step 221 
of activation of NRB scheduler: in step 821 one of the 
two schedulers is selected according to a controlling 
rule, for instance, each scheduler is run alternatively. 

is Depending on the selected scheduler, the Minimum 
Service scheduler, serving the Minimum Service con- 
nections is activated (step 822) or the NRB scheduler 
serving the NRB connections is activated (step 823). 
Once activated, the selected scheduler has either some 

20 work to do (queues 1 50 or 1 55 not empty) and the next 
step 223 is performed, or the selected scheduler has no 
work to do (queue empty) and step 220 is performed 
activating the priority mechanism. 

Figure 6 illustrates the use of the input and the out- 

25 put traffic scheduling according to the present invention 
in the adapter cards of an ATM network element 600; 
this network element switches between an end user 602 
and an end user 604 ATM traffic such as RB ; NRB or 
Minimum Service. The traffic enters the network ele- 

30 ment 600 via an ATM link 632 into the Transmit adapter 
card 620. The Transmit adapter card processes first the 
ATM physical layer in the component 670 and the data 
is then queued in the DATA STORE component 660. 
The apparatus implementing the method of the inven- 
ts tion so called 'ATM processing' (650) schedules the cells 
for transmission to. the switch 610 according to the 
present invention through the switch interface 640. The 
cells reach the switch 610 via internal links 630. Once 
the network switching process is performed in the switch 

-to the cells are sent for transmission out of the switch to a 
Receive adapter (621) through internal links 630. The 
cells are conveyed to the scheduling apparatus of the 
present invention (650) of the Receive adapter through 
a switch interface 640 and a data store 660. After being 

•*s scheduled according to the present invention, the cells 
go through the ATM physical layer processed in the 
component 670. The cells are then sent to the destina- 
tion 604 on output ATM links 632 from the network ele- 
ment 600. 

50 Figure 7 illustrates one implementation in a network 
element of the scheduling scheme of the present inven- 
tion for the support of ABR connections. To support the 
ABR service, the scheduling scheme will be combined 
with a per-connection measurement mechanism provid- 
es ing feedback information to the source either using the 
EFCI (Explicit Forward Congestion Information) cell 
marking or the Relative Rate marking as defined by the 
ATM Forum specification. This combination is imple- 
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mented in the Receive and the Transmit adapters of all 
the network elements of the A BR connection paths. In 
Figure 7, the source (710) sends data cells and control 
cells (Resource Management. RM, cells) to the destina- 
tion (720). The traffic crosses in Figure 7 two network 5 
elements (600). Implementing the scheduling scheme 
of the present invention in the ATM processing (650) lay- 
er of their Transmit and Receive adapters (620, 621). 
The destination (720) turns around the RM cells back to 
the source (710), closing the ABR control loop (730). *o 
The congestion measurement of each adapter (741 ) us- 
ing the queue status of the ATM processing (650) trig- 
gers the RM cells marking processes (740, 742) of the 
backward control cell flow. The marking process 740 us- 
es the congestion indication bit (CI) and the No Increase 
(Nl) bit field of the RM control cell: the process 742 of 
the network element located in the network element at 
the ingress of the network, the nearest to the source, 
does not use the CI bit: it indicates in the RM control 
cells an explicit rate equal to the minimum cell rate to 20 
indicate directly to the source that its traffic needs to be 
reduced. 

Optionally, a hop-by-hop backpressure mechanism 
(as described in the prior art) can be added in each node 
of the ABR path: backpressure commands (750) are -25 
sent backward from one ATM processing scheme (650) 
to the upstream one and are triggered by the same per- 
connection measurement mechanism triggering also 
the ABR feedback process for the source. The conse- 
quence of the backpressure is that the upstream back- 30 
pressured ATM processing unit (650) will reduce the 
transmission rate of the backpressured connections to 
their MCR, at the maximum, this bandwidth represent- 
ing the rate guaranteed by ATM processing unit 650. 
This will avoid immediately congestion increase. Com- 35 
btned with the ingress network RM cell marking process 
(742) which provides the backpressure command on the 
last hop back to the source, the backpressure mecha- 
nism results in a loss free ABR service. 



Claims 

1. A method for receiving and transmitting in a packet 
network node the packets of connections for which 
a minimum of bandwidth is reserved at connection 
establishment: said method comprising the steps 
of: 

receiving a packet in a dedicated connection so 
queue: 

scheduling, under the control of absolute time, 
the connection queues according to the rate 
corresponding to their reserved bandwidths: 
storing queue identifiers of the scheduled con- 55 
nection queues: 

reading the stored connection queue identifi- 
ers, and if any identifier is found, transmitting 



the first packet, if any packet is found, of the 
connection queue corresponding to the identi- 
fier read: 

if no identifier is stored, scheduling the connec- 
tion queues and transmitting the first packet, if 
any packet is found, of the scheduled queues. 

2. The method of claim 1 further supporting a second 
type of connections for which a fixed bandwidth has 
been reserved at connection establishment: said 
method characterized in that it further comprises 
the following step after the first scheduling step: 

if the scheduled connection belongs to the sec- 
ond type of connection transmitting the first 
packet, if any packet is found, of the scheduled 
queue: if not, 

3. The method of anyone of claim 1 or 2 further sup- 
porting a third type of connections for which no 
bandwidth is reserved at connection establishment: 
said method being characterized in that the receiv- 
ing step and the second scheduling steps are per- 
formed on connections for which no bandwidth is 
reserved at connection establishment. 

4. The method of claims 1 to 3 for use in network 
nodes located on the path between a source and a 
destination end-system, further supporting connec- 
tions of first type between said end-systems estab- 
lishing a control loop (730) comprising control pack- 
ets sent by said source to said destination end-sys- 
tems and returned back by said destination to said 
source end-system : said method further compris- 
ing the steps of: 

for a given connection of first type, measuring 
queueing levels (745) in said node and when 
defined thresholds are passed, 

writing in control packets on the control loop 
(730) in their way back to the source, the bit 
corresponding to the exceeded threshold, 

5. The method of claim 4 for use in a network node 
adjacent to the source, further comprising the step 
of: 

writing the minimum bandwidth value reserved 
for said first type connection at connection es- 
tablishment in a dedicated field of said control 
packets when a specific threshold is exceeded. 

6. The method of anyone of claims 1 to 5 where the 
second scheduling step (1 30) is controlled by com- 
mands of a network traffic flow control. 

7. The method of anyone of claim 1 to 6 where the 
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packet network is an ATM network and the packets 
are ATM cells. 

An apparatus for receiving and transmitting in an 
Asynchronous Transfer Mode (ATM) network node, 5 
the traffic cells of connections for which a minimum 
of bandwidth is reserved at connection establish- 
ment: said apparatus comprising the following 
means: 

10 

means for reading the incoming cell, and 
queueing it (1 00) in a connection specific queue 
(150) reachable by a scheduler (130), 

means for scheduling, under the control of ab- '5 
solute time, the connection queues (111) ac- 
cording to the rate corresponding to their re- 
served bandwidths: 

means for storing, each time a queue is sched- ?o 
uled, in a queue of connection queue identifiers 
(174) the identifier of said connection queue: 

means for reading (178) the stored connection 
queue identifiers, and if any identifier is found, 
transmitting the first packet, if any packet is 
found, of the connection queue corresponding 
to the identifier read: 

if no identifier is stored, scheduling the connec- 30 
tion queues and transmitting the first packet, if 
any packet is found, of the scheduled connec- 
tion queue. 

A receiving network adapter (620) receiving cells, 35 
from output links and transmitting said cells on in- 
ternal links (630), of connections established be- 
tween a source (602) and a destination (604) in an 
ATM network and for which a minimum bandwidth 
has been reserved at connection establishment: -to 
said adapter comprising: 

means (670) for processing the physical layer 
of data received cells via input network lines 
(632) from sources (602), 

means for (660) queueing the cells processed 
by the physical layer component, 

the apparatus (650) according to claim 8 for re- 50 
ceiving and transmitting, according to the min- 
imum bandwidth reserved at connection estab- 
lishment, said cells queued in the means for 
queuing, 

55 

means for (640) sending said cells on output 
links (630). 



10. A transmitting network adapter (620) for transmit- 
ting cells, received from internal links (630) on out- 
put links, of connections established between a 
source (602) and a destination (604) in an ATM net- 
work and for which a minimum bandwidth has been 
reserved at connection establishment: said adapter 
comprising: 

means for (640) receiving cells from internal 
links (630): 

the apparatus (650) according to claim 8 for re- 
ceiving and transmitting, according to the min- 
imum bandwidth reserved at connection estab- 
lishment, said cells queued in the data store 
component, 

means for (660) storing the cells: 

means for (670) processing the physical layer 
of cells before sending them to destinations 
(604) via output network lines (632). 

11. A network element (600) connecting lines (632), 
supporting connections between a source (602) 
and a destination (604) in an ATM network; said 
connections having a minimum bandwidth reserved 
at connection establishment: said network element 
comprising: 

at least one adapter according to claim 9 r for 
receiving data sent by the connections sources 
602 via the input network lines (632) and trans- 
mitting it on output internal links (630), 

means for (610) switching the data received 
from said receiving means (620) towards one 
internal links (630), 

at least one adapter, according to claim 10 ; for 
transmitting data received from switching 
means via the internal input links (630), to out- 
put network lines (632) towards the connection 
destination (604). 
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(57) The invention discloses a method and an ap- 
paratus for use in the packet networks and particularly 
Asynchronous Transfer Mode (ATM) networks to sup- 
port traffic of connections requiring a minimum band- 
width at connection establishment. The method and the 
apparatus further support any mixed traffic including 
connections requiring a minimum bandwidth, a fixed re- 
served bandwidth or no bandwidth at connection estab- 
lishment. 

The invention consists in using a first scheduler trig- 
gered by absolute time for scheduling the Minimum 



Service connections up to a rate corresponding to their 
reserved minimum bandwidth reserved, a second 
scheduler and a queue of Minimum Service connection 
identiers for communication between the two schedul- 
ing schemes. 

With the dual scheduling mechanism of the inven- 
tion the minimum bandwidth for connections reserving 
a minimum bandwidth at connection establishment is 
guaranteed in each point of the connection path and at 
any time, the level of fairness of the remaining band- 
width sharing depending on the quality of the second 
scheduler. 
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